Genetic Approach to Feature Selection for Ensemble

Ensembles of classiiers have been shown to be very eeective for case-based classiication tasks. The vast majority of ensemble construction algorithms use the complete set of features available in the problem domain for the ensemble creation. Recent work on randomly selected subspaces for ensemble construction has been shown to improve the accuracy of the ensemble considerably. In this paper we focus our attention on feature selection for ensemble creation using a genetic search approach. We compare boosting and bagging techniques using three approaches for feature selection for ensemble construction. Our genetic-based method produces more reliable ensembles and up to 80% in memory reduction on the datasets employed.